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l_j ' Abstract 

cu ■ 

i , An important issue towards a broader acceptance of answer-set programming (ASP) is the deploy- 

Y^ • ment of tools which support the programmer during the coding phase. In particular, methods for 

debugging an answer-set program are recognised as a crucial step in this regard. Initial work on 
debugging in ASP mainly focused on propositional programs, yet practical debuggers need to han- 
dle programs with variables as well. In this paper, we discuss a debugging technique that is directly 
^ I geared towards non-ground programs. Following previous work, we address the central debugging 

question why some interpretation is not an answer set. The explanations provided by our method are 
computed by means of a meta-programming technique, using a uniform encoding of a debugging 
request in terms of ASP itself. Our method also permits programs containing comparison predicates 
and integer arithmetics, thus covering a relevant language class commonly supported by all state-of- 
C^^ ' the-art ASP solvers. 

o. 

("^ , KEYWORDS: answer-set programming, program analysis, debugging 



^ ' 1 Introduction 

C^ . 

During the last decade, answer-set programming (ASP) has become a well-acknowledged 

paradigm for declarative problem solving. Although there exist efficient solvers (see, e.g., 
IDenecker et al.l ( 120091 ) for an overview) and a considerable body of literature concerning 
the theoretical foundations of ASP, comparably little effort has been spent on methods to 
support the development of ASP programs. Especially novice programmers, tempted by 
the intuitive semantics and expressive power of ASP, may get disappointed and discour- 
aged soon when some observed program behaviour diverges from his or her expectations. 
Unlike for other programming languages like Java or C-H-, there is currently little sup- 
port for debugging a program in ASP, i.e., methods to explain and localise unexpected 
observations. This is a clear shortcoming of ASP and work in this direction has already 
started dBrain and De Vos 2005l|Syrjanen 2006|IBrain et al. 2007IIMikitiuk et al. 2007IICaballero et al. 20081 
iGebser et al. 20081 IPontelli et al. 20091 IWttocx et al. 2009l l. 

* This work was partially supported by the Austrian Science Fund (FWF) under grant P21698. 
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Most of the current debugging approaches for ASP rely on declarative strategies, focus- 
ing on conceptual errors of programs, i.e., mismatches between the intended meaning and 
the actual meaning of a program. In fact, an elegant realisation of declarative debugging is 
to use ASP itself to debug programs in ASP. This has been put forth, e.g., in the approaches 
of lBrain et al.l(l2007l) and lGebser et al.l(l2008l) . While the former uses a "tagging" method 
to decompose a program and applying various debugging queries, the latter is based on a 
meta-programming technique, i.e., using a program over a meta-language to manipulate a 
program over an object language (in this case, both the meta-language and the object lan- 
guage are instances of ASP). Such techniques have the obvious benefits of allowing (i) to 
use reliable state-of-the-art ASP solvers as back-end reasoning engines and (ii) to stay 
within the same paradigm for both the programming and debugging process. Indeed, both 
approaches are realised by the system spock JGebser et al. 20091 ). However, like most 
other ASP debugging proposals, spock can deal only with propositional programs which 
is clearly a limiting factor as far as practical applications are concerned. 

In this paper, we present a debugging method for non-ground programs following the 
methodology of the meta-programming approach of lGebser et al.lfeOOS ) for propositional 
programs. That is to say, we deal with the problem of finding reasons why some inter- 
pretation is not an answer set of a given program. This is addressed by referring to a 
model-theoretic characterisation of answer sets due to ILeel (120051) : An interpretation / is 
not an answer set of a program P iff (i) some rule in P is not classically satisfied by / 
or (ii) / contains some loop of P that is unfounded by P with respect to /. Intuitively, 
Item (ii) states that some atoms in / are not justified by P in the sense that no rules in P 
can derive them or that some atoms are in / only because they are derived by a set of rules 
in a circular way — Uke the Ouroboros, the ancient symbol of a dragon biting its own tail 
that represents cyclicality and eternity. This characterisation seems to be quite natural and 
intuitive for explaining why some interpretation is not an answer set. Furthermore, a par- 
ticular benefit is that it can ease the subsequent localisation of errors since the witnesses 
why an interpretation is not an answer set, like rules which are not satisfied, unfounded 
atoms, or cyclic rules responsible for unfounded loops, can be located in the program or 
the interpretation. 

Although, at first glance, one may be inclined to directly apply the original approach of 
IGebser et al. 1(120081 ) to programs with variables by simply grounding them in a preprocess- 
ing step, one problem in such an endeavour is that then it is not immediate clear how to 
relate explanations for the propositional program to the non-ground program. The more se- 
vere problem, however, is that the grounding step requires exponential space and time with 
respect to the size of the problem instance which yields a mismatch of the overall complex- 
ity as checking whether an interpretation is an answer set of some (non-ground) program 
is complete for III' (lEiter et al. 20041 ). and thus the complementary problem why some in- 
terpretation is not an answer set is complete for Sl' — our method to decide this problem 
accounts for this complexity bound and avoids exponential space requirements. Indeed, we 
devise a uniform encoding of our basic debugging problem in terms of a fixed disjunctive 
logic program F and an efficient reification of a problem instance as a set A(P, /) of facts, 
where P is the program to be debugged and / is the interpretation under consideration. 
Explanations why / is not an answer set of P are then obtained by the answer sets of 

ruA(p,/). 
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We stress that the definition of F is non-trivial: while the meta-program in the approach 
of lGebser et al.l(l2008l l for debugging propositional disjunctive programs could be achieved 
in terms of a normal non-ground program, by uniformly encoding a 1^2 property, we reach 
the very limits of disjunctive ASP and have to rely on advanced saturation techniques that 
inherently require disjunctions in rule heads (lEiter et al. 19971 1. 

Currently, our approach handles disjunctive logic programs with constraints, integer 
arithmetic, comparison predicates, and strong negation, thus covering a practically relevant 
program class. Further language constructs, in particular aggregates and weak constraints, 
are left for future work. 



2 Prelimmaries 
We deal with disjunctive logic programs which are finite sets of rules of form 

aiV ■■■V ai -h- a;+i,. . . , a™, not a^+i, . . . , not a„, 

where n > m > I > 0, "not" denotes default negation, and all Ui are literals over a 
function-free first-order language L. A literal is an atom possibly preceded by the strong 
negation symbol -i. In the sequel, we assume that L will be implicitly defined by the con- 
sidered programs. For a rule r as above, we define the head of r as H{r) — {ai, . . . , ai}, 
the positive body as B~^{r) = {aj+i, . . . , am}, and the negative body as B^{r) — 
{«,„+!, • • • , On}- If n = I = 1, r is a fact; if r contains no disjunction, r is normal; 
and if / = and n > 0, r is a constraint. For facts, we will omit the symbol ^— . A literal, 
rule, or program is ground if it contains no variables. Furthermore, a program is normal if 
all rules in it are normal. Finally, we allow arithmetic and comparison predicate symbols 
+, *, =, y^, <, <, >, and > in programs, but these may appear only positively in rule 
bodies. 

Let C be a set of constants. A substitution over C is a function -d assigning each vari- 
able an element of C. We denote by e'd the result of applying i? to an expression e. The 
grounding of a program P relative to its Herbrand universe, denoted by grd{P), is defined 
as usual. 

An interpretation I (over some language L) is a finite and consistent set of ground lit- 
erals (over L) that does not contain any arithmetic or comparison predicates. Recall that 
consistency means that {a, -la} % I, for any atom a. The satisfaction relation, I \= a, 
between / and a ground atom, a literal, a rule, a set of literals, or a program a is defined in 
the usual manner. Note that the presence of arithmetic and comparison operators implies 
that the domain of our language will normally include natural numbers as well as a lin- 
ear ordering, <, for evaluating the comparison relations (which coincides with the usual 
ordering in case of constants which are natural numbers). 

For any ground program P and any interpretation /, the reduct, P^ , of P with respect 
to / JGelfond and Lifschitz 19911 ) is defined as P' = {H{r) ^ B+{r) \ r e P,I D 
B~{r) = 0}. An interpretation / is an answer set of a program P iff / is a minimal model 
of grd{P). 

We will base our subsequent elaboration on an alternative characterisation of answer 
sets following |Lee (2005j ), described next. Given a program P, the positive dependency 
graph is a directed graph {V, A), where (i) V equals the Herbrand base of the considered 
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language L and (ii) (a, h) e yl iff a G H{r) and h E B^{r), for some rule r £ grd{P). 
A non-empty set L of ground literals is a JooflJ of a program P iff, for each pair a, 6 S L, 
there is a path vr of length greater than or equal to from a to 6 in the positive dependency 
graph of P such that each literal in tt is in L. 

Let P be a program and / and J interpretations. Then, J is externally supported by P 
with respect to / iff there is a rule r e grd{P) such that (i) / ^ B^{r) and lr\B~{r) = 0, 
(ii) H{r) n J ^ 0, (iii) {H{r) \J)r\I = t and (iv) B+{r) nJ = 0. 

Intuitively, Items (i)-(iii) express that J is supported by P with respect to /, in the sense 
that the grounding of P contains some rule r whose body is satisfied by / (Item (i)) and 
which is able to derive some literal in J (Item (ii)), while all head atoms of r not contained 
in J are false under /. Moreover, Item (iv) ensures that this support is external as it is 
without reference to the set J itself. 

Answer sets are now characterised thus: 

Proposition 1 iLee\2005i 

Let F be a program and / an interpretation. Then, / is an answer set of P iff {i) I ^ P and 

(ii) every loop of P that is contained in / is externally supported by P with respect to /. 

We actually make mainly use of the complementary relation of external support: Follow- 
ing [LeoneeFair(1997|, we call J unfounded by P with respect to I iff J is not externally 
supported by P with respect to /. 



3 The basic debugging approach 

As discussed in the introduction, we view an error as a mismatch between the intended 
answer sets and the observed actual answer sets of some program. More specifically, our 
basic debugging question is why a given interpretation / is not answer set of some program 
P, and thus we deal with finding explanations for / not being an answer set of P. Proposi- 
tion[T]allows us to distinguish between two kinds of such explanations: (i) instantiations of 
rules in P that are not satisfied by / and (ii) loops of f in / that are unfounded by P with 
respect to /. Although our basic debugging question allows for different, multi-faceted, 
answers, we see two major benefits of referring to this kind of categorisation: First, in view 
of Proposition[T] these kinds of explanations are always sufficient to explain why / is not 
an answer set of P, and second, this method provides concrete witnesses, e.g., unsatisfied 
rules or unfounded atoms, that can help to localise the reason for an error in a program or 
an interpretation in a rather intuitive way. 

Before we introduce the details of our approach, we discuss its virtues compared to a 
method for debugging non-ground programs which can be obtained using the previous 
meta-programming technique for prepositional programs due to |Gebser et al. (2008| l. 



^ Note that loops have first been studied bv lLin and Zhao|j2004t ; different definitions of loops for non-ground 
programs were given bv lChen et al.lf2006t and |Lee and Meng]42008V For our purposes, it suffices to refer to 
the basic definition for ground programs. 
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3.1 Prelude: A case for directly debugging non-ground programs 

Explaining why some interpretation is not an answer set of some program based on the 
characterisation of Lee (2005 j has been dealt with in previous work for debugging propo- 
sitional disjunctive logic programs JGebser et al. 2008l l. In principle, we could use this 
method for debugging non-ground programs as well by employing a preparatory ground- 
ing step. However, such an undertaking comes at a higher computational cost compared to 
our approach which respects the inherent complexity of the underlying tasks. We lay down 
our arguments in what follows. 

To begin with, let us recall that |Gebser et al. (2008| ) defined a fixed normal non-ground 
program 7 and a mapping S from disjunctive propositional programs and interpretations to 
sets of facts. Given a disjunctive program P without variables and some interpretation /, 
explanations why / is not an answer set of P can then be extracted from the answer sets of 
7 U S{P, I). Such a problem encoding is uniform in the sense that 7 does not depend on 
the problem instance determined by P and /. 

To find reasons why some interpretation / is not an answer set of a non-ground program 
P, the above approach can be used by computing the answer sets of 7 U S{grd{P), I). 
However, in general, the size of grd{P) is exponential in the size of P, and the computation 
of the answer sets of a ground program requires exponential time with respect to the size 
of the program, unless the polynomial hierarchy collapses. Hence, this outlined approach 
to compute explanations using a grounding step requires, all in all, exponential space and 
double-exponential time with respect to the size of P. But this is a mismatch to the inherent 
complexity of the overall task, as the following result shows: 

Proposition 2 

Given a program P and an interpretation /, deciding whether / is not an answer set of P 

is n|' -complete. 

This property is a consequence of the well-known fact that the complementary problem, 
i.e., checking whether some given interpretation is an answer set of some program, is Sf - 
complete (.Eiter et al. 2004 J . Hence, checking whether an interpretation is not an answer 
set of some program can be computed in polynomial space. 

Our approach takes this complexity property into account. We exploit the expressive 
power of disjunctive non-ground ASP by providing a uniform encoding that avoids both 
exponential space and double-exponential time requirements: Given a program P and an 
interpretation /, we define an encoding F U A(i-', /), where F is a fixed disjunctive non- 
ground program, and A(F, /) is an efficient encoding of P and / by means of facts. Expla- 
nations why / is not an answer set of P are determined by the answer sets of F U A(i-', /). 
Since F is fixed, the grounding of F U A{P, I) is bounded by a polynomial in the size of 
P and /. Thus, our approach requires only polynomial space and single-exponential time 
with respect to P and /. 

Note that disjunctions can presumably not be avoided in F due to the Fll'-hardness of 
deciding whether an interpretation is not an answer set of some program. One may ask, 
however, whether F could be normal in case P is normal. We have to answer in the nega- 
tive: answer-set checking for normal programs is complete for D , even if no negation is 
used or negation is only used in a stratified way jEiter et al. 2004l l. (We recall that D is 
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the class of problems that can be decided by a conjunction of an NP and an independent 
co-NP property.) Hence, T cannot be normal unless NP = co-NP. However, one could use 
two independent normal meta-programs to encode our desired task. 

A further benefit of debugging a program directly at the non-ground level is that we 
can immediately relate explanations for errors to first-order expressions in the considered 
program, e.g., to rules or literals with variables instead of their ground instantiations. 

In what follows, we give details of F and A and describe their main properties. 

3.2 Construction of the meta-program 

3.2.1 Reification of input instances 

For realising the encoding A(P, /) for program P and interpretation /, we rely on a reifi- 
cation Qprg{P) of P and a reification gmt{I) of /. The former is, in turn, constructed from 
reifications Qmieir) of each individual rule r <E P. We introduce the mappings Qmiei), 
Qprg{-), and gi„,{-) in the following. 

To begin with, we need unique names for certain language elements. By an extended 
predicate symbol (EPS) we understand a predicate symbol, possibly preceded by the sym- 
bol for strong negation. Let •' be an injective labelling function from the set of program 
rules, literals, EPSs, and variables to a set of labels from the symbols in our language L. 
Note that we do not need labels for constant symbols since they will serve as unique names 
for themselves. 

A single program rule is reified by means of facts according to the following definition. 

Definition 1 

Let r be a rule. Then, 

Qruie{r) = {rule{r')} U {head{r' , a') \ a e H{r)}U 

{posbody{r', a') \ a e B+{r)} U {negbody{r' , a') \ a e S"(r)}U 
{pred{a\ L') \ a = L{xi, . . . , a;„) is a literal in r, L is an EPS}U 
{struct{a' , i, var, x^) \ a — L{xi, . . . , a;„) is a literal in r, L is an EPS, 

i S {!,..., n}, and x^ is a variablejU 
{struct{a' , i, const, x^) \ a ~ L{xi, . . . , a;„) is a literal in r, L is an EPS, 

i £ {1, . . . , n}, and x^ is a constant symboljU 
{var{r' , x') | a; is a variable occurring in r}. 

The first fact states that label r' denotes a rule. The next three sets of facts associate labels 
of the literals in the head, the positive body, and the negative body to the respective parts 
of r. Then, each label of some literal in r is associated with a label for its EPS. The 
following two sets of facts encode the positions of variables and constants in the literals of 
the rule. Finally, the last set of facts states which variables occur in the rule r. 
A program is encoded as follows: 

Definition 2 

Let F be a program. Then, 

Qprg{P) — UreP Bruie{r) U {dom{c) I c is a constant symbol in _P}U 

{arity{L' , n) | a = L{xi, . . . , Xn) is a literal in P, L is an EPS}. 
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7»".M ~ {guessRule{R) V nguessRule{R) <r- nde{R), 
someRule <— guessRule{R), 
<— not someRule, rule{R), 
■(— guessRule(Ri) , guessRule{R2) , Ri 7^ -R2, 

subst{X , C) V nsubst{X , C) <— guessRule(R) ,var{R, X),dom{C), 
assigned[X) -f- subst{X , C), 
<— not assigned{X) , guessRule{R) , var{R, X), 
^ subst{X, Ci),subst{X, C2), Ci / C2}. 

7un.M ~ {unsatisfied ■(— satBody, not satHead, 

satBody -^ not unsatPosbody , not unsatNegbody , 
satHead -f- guessRule{R) , head( R, A), true{A), 
unsatPosbody <— guessRule{R),posbody{R, A),false{A), 
unsatNegbody <~ guessRule{R), negbody{R, A), true{A)}. 

Fig. 1. Modules 7S' and 7;iS. 

The first union of facts stem from the reification of the single rules in the program. The 
remaining facts represent the Herbrand universe of the program and associate the EPSs 
occurring in the program with their arities. 

The translation from an interpretation to a set of facts is formalised by the next definition. 

Definition 3 

Let / be an interpretation. Then, 

Qini{I) — {int{a') | a £ /} U {pred{a' , L') \ a = L{xi, . . . , Xn) is a literal in /, 
LisanEPSjU 
{struct{a' , i, const, Xi) \ a = L{xi, . . . , Xn) is a literal in /, L is an EPS, 
i G {1, . . . , Ti}, and Xi is a constant symbol}. 

The first two sets of facts associate the literals in / with their respective labels and EPSs. 
The last set of facts reifies the internal structure of the literals occurring in /. 

Definition 4 

Let P be a program and / an interpretation. Furthermore, let A^ be the the maximum of 
|/| and the arities of all predicate symbols in P. Then, A{P,I) = Qprg{P) U Qmt{I) U 
{natNumber{n) | n e {0, . . . , -A''}}. 

The literals natNumber{-) are necessary to add sufficiently many natural numbers to the 
Herbrand universe of A(i-', /) to carry out correctly all computations in the subsequent 
program encodings. Note that the size of A{P, I) is always linear in the size of P and /. 

3.2.2 The meta-program T 

We proceed with the definition of the central meta-program F. The complete program 
consists of more than 160 rules. For space reasons, we only present the relevant parts and 
omit modules containing simple auxiliary definitions. The full encodings can be found at 

[www. kr ■ tuwien . ac . at /re search/pro jects/mmdasp/ encoding . tar . gz| 
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The meta-program F consists of the following modules: (i) ^umm, related to unsatisfied 
rules, (ii) 7/oop, related to loops, (iii) 7„„ya, for testing unfoundedness of loops, and (iv) ^cons, 
integrating Parts (i)-(iii) for performing the overall test of whether a given interpretation / 
is not an answer set of a given program P. 

We first introduce the program module ^u„sat to identify unsatisfied rules. 

Definition 5 

By 7„„,flf we understand the program lfZ''t^lunfai^l''msat^ where 7S' and -f'*lf, are given 

in Figure[Tl and 7^"^, defines the auxiliary predicates true(-) andfalse{-). 

Intuitively, for a program P and an interpretation /, ju^sai guesses a rule r ^ P, repre- 
sented by predicate guessRule, and a substitution d, represented by subst, and Yunfat defines 
that unsatisfied holds if / ^ r-d. Module 7™^^, (omitted for space reasons) defines the aux- 
iliary predicates true{-) 2iVid false {■) such that true {I') holds if / ^ Id, for some literal /, 
and/flZie(r) holds if/ ^ W. 

Module 7„„.5fl, has the following central property: 

Theorem 1 

Let P be a program and / an interpretation. Then, / ^ P iff some answer set of ^unsat U 
A(P, /) contains unsatisfied. More specifically, for each rule r € P with / ^ r^, for 
some substitution 1) over the Herbrand universe of P, ■junsnr U A(P, /) has an answer set S 
such that (i) {unsatisfied, guessRule{r')} C S and (ii) subst{x' , c) e 5* iff i9(a;) ~ c. 

We next define module ■^loop for identifying loops of a program. 

Definition 6 

By -fhop we understand the program -ff"^^' U jfj^^^f U 7,™^^, where -ff"^^' and 7^^^^^^* are given 

in Figurelll and 7,^'" defines the auxiliary predicates loopSz{-) and differSeq{-, ■, ■). 

Intuitively, for a program P and an interpretation /, 7£"p** guesses a non-empty subset 
L of /, represented by inLoop{-), as a candidate for a loop, and 'j^g^p'' defines that isLoop 
holds if L is a loop of P. More specifically, this check is realised as follows. Assume L 
contains n literals. 

1. Guess a set ^ of n pairs (r, ^), where r is a rule from P and i? is a substitution over 
the Herbrand universe of P. 

2. Check, for each a.b E L, whether there is a path tt in the positive dependency graph 
of the ground program consisting of rules {r-d \ (r, d) G Q} such that tt starts with 
a and ends with b, and all literals in tt are in L. A path tt is represented by the binary 
predicate /5flf/!(-, •). 

Module jf"g (again omitted for space reasons) defines that (i) loopSz{n) holds if |P| = n 
and (ii) differSeq{i, a' , b') holds if ai) ^ bi), where a, b are literals and d is the substitution 
stemming from a pair in Q that is associated with an index i by 7/00^. 

Theorem 2 

For any program P and any interpretation /, P C / is a loop of P iff, for some answer set 

S oijioop U A(P, /), isLoop G S and L—{x\ inLoop{x') G S}. 
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^io"p = {inLoop{X) V outLoop[X) -h- int(X), 
somelnLoop <r- inLoop{X), 
<r- not somelnLoop, int{X)}. 

lioof = {inRuleSet(N , R) V outRuleSet{N , R)^1<N,N<S, loopSz{S), rule{R), 

natNumber{N), 
someRule{N) <— inRuleSet{N , R), 

<— not someRule{N), I < N,N < S, loopSz(S), rule(R) , natNumber{N) , 
<— inRuleSet{N , Ri), inRuleSet{N , R2),Ri / R2, 
^ inRuleSet{Ni,Ri), inRuleSet{N2, R2), Ni < N2, Ri > R2, 
loopSubst{N, X, C) V nloopSubst{N , X, C) <- var{R, X),dom{C), 

inRuleSet(N , R), 
loopAssigned{N , X) <— loopSubst{N , X , C), 
<— not loopAssigned{N , X),inRuleSet[N , R),var{R, X), 
^ loopSubst{N , X, Ci), loopSubst{N , X, C2), Ci / C2, 
isLoop <— not unreachablePair, inLoop{X), 
unreachablePair ■<— inLoop{X), inLoop( Y), not path(X , Y), 
path{X , X) -/^ inLoop{X), 

path{X , Y) ■(— inLoop{X),inLoop{Y),pred{X , Ti),pred{Y , T2),loopSz{S), 
1< N,N < S,head{R,H),inRuleSet{N,R),posbody{R,B), 
pred{H, Ti),pred{B, T2), not differSeq(N, X, H), 
not differSeq{N , Y,B), 
path{X, Z) <— inLoop{X),inLoop{Z),path{X, Y),path{Y, Z)}. 



Fig. 2. Modules 7,*"^" and 7^' 



oop 



7™// = {variable{X) <- var{R,X), 

suppSubst{X , C) y nsuppSubst{X , C) <— variable{X),dom{C), 

saturate <— suppSubst{X , Ci),suppSubst{X, C2), Ci 7^ C2, 

saturate •(— unassigned{X), 

unass{X , C) <^ first{C),nsuppSubst{X , C), 

unass{X, C2) <— succ{Ci, C2),unass(X , Ci),nsuppSubst{X , C2), 

unassigned{X) <— last{C),unass{X , C) }. 

lunff = {unfounded <— unsupp{R) , lastR{R) , 

unsupp (R) ^^ firstR{R), unsuppRule (R), 
unsupp{R2) -^ succR{Ri, R2), unsupp{Ri), unsuppRule (R2), 
saturate •<— unfounded, 

suppSubst{X , C) <r- variable(X) , dom(C) , saturate , 
nsuppSubst{X , C) -^ variable(X),dom{C), saturate }U 
{unsuppRule (R) •<— Ci{R) \ i £ {1, . . . , 5}}. 

Fig. 3. Modules -fZf^ and Yutff- 

We proceed with module junfd for checking whether some set J of ground literals is un- 
founded by P with respect to an interpretation /. We later combine this co-NP check with 
jioop to identify unfounded loops, i.e., we will integrate a loop guess with a co-NP check, 
thus reaching the very limits of disjunctive ASP by uniformly encoding a Sl' property. 

Definition 7 

By -yunfd we understand the program 7^;^/ U jf4f U Yu"„}d' where 7^;;;' and Yun}f are given 
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in Figure[3] and 7°"|y defines the auxiliary predicates succ{-, •), succR{-, ■),first{-), last{-), 
firstR{-), lastR{-), and ci(-), . . . , c^{-). 

The intuition behind this definition is as follows. Consider a program P, some set J 
of ground literals, encoded via mLoop{-), and an interpretation /. Module 7f"fJ* non- 
deterministically guesses a binary relation suppSubst{-, ■) between the variables and the 
constant symbols in P. In case this relation is not a function, 7f^'5J' establishes saturate. 
Module 7^^«*^, in turn, encodes whether, for each substitution -d and each rule r £ P, 
some of the conditions from the definition of J being externally supported by P is vi- 
olated. In fact, unfounded is derived if some of these conditions is violated. Moreover, 
saturate holds if unfounded holds, and 7^^S'^ saturates the relation defined by predicate 
suppSubst{- , ■) if saturate holds. Module 7°"L (omitted for space reasons) defines succ{-^ ■) 
and succR{-, ■), which express the immediate successor relation, based on ^, for the con- 
stant symbols and rules in P, respectively, as well as the predicates first{-),firstR{-), last{-), 
and lastR{-), which mark the first and the last elements in the order defined by succ{-, •) and 
succR{-, •), respectively. Moreover, the module 7™i defines predicates ci (•),..., C5(-), ex- 
pressing failure of one of the conditions for J being externally supported by P with respect 
to/. 

The rough idea behind the encoded saturation technique is to search, via 'yfil^", for coun- 
terexample substitutions that witness that the set J of ground literals is not unfounded. For 
such a substitution, neither saturate nor unfounded can become true which implies that no 
answer set can contain unfounded due to the saturation of suppSubst{-, ■) and the minimal- 
ity of answer sets. 

Theorem 3 

Consider a program P, an interpretation /, and a set J of ground literals. Then, J is un- 
founded by P with respect to /iff the unique answer set of 7„„ya U A(P, /) U {mLoop{x') \ 
X € J} contains the literal unfounded. 

Given the above defined program modules, we arrive at the uniform encoding of the 
overall program T. 

Definition 8 

Let 7„„5a,, 7/oop, and 7„„y;v be the programs from Definitions |5]|6] and|7] respectively. Then, 

r = 7„„.Mf U jioop U 7„„/a U 7eo„s, where 

Jams — {notAnswerSet -f- unsatisfied, notAnswerSet <— isLoop, unfounded, 
<— not notAnswerSet}. 

Module jcons encodes that each answer set of F witnesses either / ^ /" or that some 
loop L C / of P is unfounded by P with respect to /. 

We finally obtain our main result, which follows essentially from the semantics of mod- 
ule jcons and Theorems [T] 121 and [3] 

Theorem 4 

Given a program P and an interpretation /, 11 = F U A(P, /) satisfies the following 

properties: 

(i) n has no answer set iff / is an answer set of P. 
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(ii) / is not an answer set of P iff, for each answer set S of H, {unsatisfied, unfounded} n 

(iii) / ^ P iff unsatisfied G S, for some answer set S of H. Moreover, for each rule 
r G P with / ^ ri?, for some substitution i3 over the Herbrand universe of P, 
there is some answer set S* of II such that (a) {unsatisfied, guessRule{r')} C S and 
(b) subst{x', c) e S \E{}{x) = c. 

(iv) A loop L C / is unfounded by P with respect to / iff some answer set 5" of II 
contains both isLoop and unfounded, and L — {x \ inLoop{x') G S{. 

4 Applying the debugging approach 

In this section, we first describe a simple scenario with different debugging tasks and show 
how the meta-program defined in the previous section can be used to solve them. After- 
wards, we discuss some pragmatic aspects relevant for realising a prospective user-friendly 
debugging system based on our approach. 

4.1 A simple debugging scenario 

We assume that students have to encode the assignments of papers to members of a pro- 
gram committee (PC) based on some bidding information in terms of ASP. We consider 
three cases, each of them illustrates a different kind of debugging problem. In the first case, 
an answer set is expected but the program is inconsistent. In the second case, multiple an- 
swer sets are expected but the program yields only one answer set. In the third case, it is 
expected that a program is inconsistent, but it actually yields some answer set. We illus- 
trate that, in all cases, our approach gives valuable hints how to debug the program in an 
iterative way. 

Assume that pc{X) means that X is a member of the PC, paper{X) means that X is a 
paper, and bids(X, Y, Z) means that PC member X bids on paper Y with value Z, where 
Z is a natural number ranging from to 3 expressing a degree of preference for that paper. 

To start with, Lucy wants to express that the default bid for a paper is 1. That is, if a 
PC member does not bid on a paper, then it is assumed that the PC member bids 1 on that 
paper per default. Lucy's first attempt looks as follows: 

Li = {pc{mi),pc{m2),paper{pi),bid{mi,pi,2),bid{m2,pi,3), 
someJ>id{M, P) ^ bid{M , P, X), 
bid{M, P, 1) ^ not someJ>id{M, P),pc{M),paper{P)]. 

Lucy's intention is that someJ)id{M, P) is true if PC member M bids on paper P, and 
bid{M , P, 1) is true if there is no evidence that PC member M has bid on that paper. 
Indeed, the unique answer set of Li is 

Si = {pc{mi),pc{m2),paper{pi),bid{mi,pi,2),bid{m2,pi,3), 
someJbid{mi ,pi), someJbid{m2 ,Pi)}- 

The answer set ^i is indeed as expected: We have that each PC member bids on some 
paper in Li and the last rule is inactive. Lucy's next step is to delete the fact bid{m2, pi , 3) 
from Li — let us denote the resulting program by L2. Lucy expects that the answer set of 
L2 contains bid{m2,pi, 1). However, it turns out that L2 yields no answer set at all! 
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To find out what went wrong, Lucy defines her expected answer set as 

El — {Si U {bid{m2,pi, 1)}) \ {someJ>id{m2,pi),bid{m2,pi,3)} 

and inspects the answer sets of F U A(L2, ^-i)- It turns out that one answer set contains the 
facts unsatisfied and guessRule{r[), where r[ is the label for the rule 

ri = some_bid{M, P) ^ bid{M , P, X). 

Hence, ri is not satisfied by Ei. bid{m2, pi, 1) is in Ei and thus satisfies the body of ri, 
but the head of ri is not satisfied since Ei does not contain someJ}id{m2, pi). 

Now that Lucy sees that L2's answer set has to contain someJ7id{m2,pi), she defines 
E2 as El plus the fact someJ>id{m2,pi). The answer sets of F U A{L2, E2) reveal that 
E2 is not an answer set of L2 because the singleton loop bid{in2, pi,l) is contained in E2 
but it is unfounded by L2 with respect to E2. The reason is clear: the only rule that could 
support bid{m2,pi, 1) is 

r2 = bid{M, P, 1) ^ not someJ>id{M, P),pc{M),paper{P). 

However, r2 is blocked since E2 contains someJ)id{m2,pi). 

Lucy concludes that, to make r2 work as expected, someJ}id{in2,pi) must not be con- 
tained in the answer set. To achieve this, Lucy changes ri, the only rule with predicate 
someJjid in the head, into 

someJ>id{M, P) ^ bid{M , P,X),X ^1. 

The resulting program works as expected and contains bid{m2, pi, 1) in its answer set. 

The next student who is faced with a mystery is Linus. He tried to formalise that each 
paper is non-deterministically assigned to at least one member of the PC. His program 
looks as follows: 

Pi = {pc{mi),pc{m2),paper{pi),paper{p2),bid{mi,pi,2), 
bid{mi,p2,3),bid{m2,pi, I),bid{m2,p2, 1), 
assigned{P , M) V -iassigned{P ^ M) ^ paper{P),pc{M), 
■^ paper{P),pc (M), not assigned{P, M)}. 

Linus expects that the disjunctive rule realises the non-deterministic guess, and then the 
constraint prunes away all answer set candidates where a paper is not assigned to some 
PC member. Now, poor Linus is desperate since the non-deterministic guess seems not to 
work correctly; the only answer set of Pi is 

S3 = {paper{pi),paper{p2),pc{mi),pc{m2),bid{mi,pi,2),bid{mi,p2,3), 
bid{m2,pi, I),bid{m2,p2, l),assigned{pi, mi),assigned{pi, 7712), 
assigned{p2, w-i), assigned{p2, "1-2)}, 

although Linus expected one answer set for each possible assignment. In particular, Linus 
expected 

E^ = {S3 U {^assigned{pi, ^2)}) \ {assigned{pi, 1712)} 

to be an answer set as well. Hence, Linus inspects the answer sets of F U A(i-'i, £^3) and 
learns that the constraint in Pi is not satisfied by E3. In particular, it is the substitution that 



Catching the Ouroboros: On Debugging Non-ground Answer-Set Programs 13 

maps the variable P to pi and M to m2 that is responsible for the unsatisfied constraint, 
which can be seen from the subst{-) atoms in each answer set that contains unsatisfied. 

Having this information, Linus observes that the constraint in its current form is un- 
satisfied if some paper is not assigned to each PC member. However, he intended it to 
be unsatisfied only when a paper is assigned to no PC member. Hence, he replaces the 
constraint by the two rules 

■i^ paper{P),pc{M), not atJeastjone{P) and at least jone{P) ^r- assigned{P , M). 

The resulting program yields the nine expected answer sets. 

Meanwhile, Peppermint Patty encounters a strange problem. Her task was to write a 
program that expresses the following issue: If a PC member M bids on some paper P, 
then this means that there is a conflict of interest with respect to M and P. In any case, 
there is a conflict of interest if M (co-)authored P. A PC member can only be assigned to 
some paper if there is no conflict of interest with respect to that PC member and that paper. 
This is Peppermint Patty's solution: 

Qi ~ {pc{mi) , paper{pi) ,bid{m,i, pi, 2),assigned{pi, mi),author{pi, mi), 
conflict jofJnte re st{M , P) <- bid{M, P, 0), 
conflict jaf-interest{M , P) <— pc{M) , paper{P) , author{ M , P), 
bid{M, P, 0) ^ pc{M), paper{P), conflict jafJnterest{M, P), 
^ assigned{P,M),bid{M,P,0)}. 

The facts in Qi should model a scenario where a PC member authored a paper and is as- 
signed to that paper According to the specification from above, this should not be allowed. 
Since Patty is convinced that her encoding is correct, she expects that Qi has no answer 
sets. But Qi has the unique answer set 

64 ~ {assigned{pi, mi) , pc(mi) , paper{pi) , author{pi , mi),bid{mi, pi,2)}. 

What Peppermint Patty finds puzzling is that 54 does not contain any atoms signalling a 
conflict of interest. Hence, she decides to analyse why 

i?4 = 54 U {conflict jofJnterest{m,i, pi) , bid{mi, pi, 0)} 

is not an answer set of Qi. If Qi was correct, then the only reason why £4 is not an answer 
set of Qi would be that the (only) constraint in Qi is unsatisfied. 

As expected, some answer sets of F U A( Qi , £4) contain unsatisfled and guessRule{r'), 
where r' is the label of the constraint in Qi. However, some answer sets contain the atom 
unfounded as well — a surprising observation. Patty learns, by inspecting the inLoop{-) 
atoms in the respective answer set, that £4 contains the loop 

{conflict jofJnterest{mi , pi), bid{mi,pi, 0)} 

which is unfounded by Qi with respect to £4: bid{mi , pi , 0) seems to be justified only by 
the literal conflict jofJnterest{mi , pi) and vice versa. This should not be the case since Qi 
contains the rule 

conflict j3fJnterest{M , P) <— pc{M),paper{P), author{M , P) 

that should support conflict jjfJnterest{mi, pi) because all the facts ;5c(mi), paper{pi). 
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and author{mi , pi ) should be contained in Qi- Now, the error is obvious: Q4 does not con- 
tain the fact author{m,i,pi) but author{pi, nii) — the order of the arguments was wrong. 
After Peppermint Patty fixed that bug, her program is correct. 



4.2 Some pragmatic issues and future prospects 

For a debugging system of practical value, certain pragmatic aspects have to be taken into 
account which we briefly sketch in what follows. To start with, our encodings can be seen 
as a "golden design" — tailored towards clarity and readability — which leaves room for 
optimisations. Related to this issue, solver features like limiting the number of computed 
answer sets or query answering are needed to avoid unnecessary computation and to limit 
the amount of information presented to the user 

Our debugging approach requires information about the intended semantics in form of 
the interpretation representing a desired answer set. Typically, answer sets of programs en- 
coding real-world problems tend to be large which makes it quite cumbersome to manually 
create interpretations from scratch. It is therefore vital to have convenient means for obtain- 
ing an intended answer set in the first place. For this purpose, we envisage a tool-box for 
managing interpretations that allows for their manipulation and storage. In such a setting, 
answer sets of previous versions of the debugged program could be a valuable source of in- 
terpretations which are then tailored towards an intended answer set of the current version. 
In addition to manual adaptations, partial evaluation of the program could significantly ac- 
celerate the creation of interpretations. We plan to further investigate these issues and aim 
at incorporating our debugging technique, along with an interpretation management sys- 
tem as outlined, in an integrated development environment (IDE). Here, an important issue 
is to achieve a suitable user interface for highlighting the identified unsatisfied rules and 
unfounded loops in the source code and for visualising the involved variable substitutions. 

5 Related work 

Besides the debugging approach by |Gebser et al. (2008| l, as already discussed earlier, other 
related approaches on debugging include the work of lPontelli et al. I ( [20091 1 on justifications 
for non-ground answer-set programs that can be seen as a complementary approach to ours. 
Their goal is to explain the truth values of literals with respect to a given actual answer set 
of a program. Explanations are provided in terms of justifications which are labelled graphs 
whose nodes are truth assignments of possibly default-negated ground atoms. The edges 
represent positive and negative support relations between these truth assignments such that 
every path ends in an assignment which is either assumed or known to hold. The authors 
have also introduced justifications for partial answer sets that emerge during the solving 
process (online justifications), being represented by three- valued interpretations. 

The question why atoms are contained or are not contained in an answer set has also 
been raised by IBrain and De Vos (2005 ) who provide algorithms for recursively comput- 
ing explanations in terms of satisfied supporting rules. Note that these problems can in 
principle also be handled by our approach, as illustrated in Section 14.11 Indeed, consider 
some program P with answer set / and suppose we want to know why a certain set L of 
literals is contained in /. Using our approach, explanations why I \ L is not an answer 
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set of P will reveal rules which are unsatisfied under / \ L but which support literals in 
L under /. Likewise, we can answer the question why expected atoms are missing in an 
answer set. 



Syrjanen (2006 1 aims at finding explanations why some propositional program has no 
answer sets. His approach is based on finding minimal sets of constraints such that their 
removal yields consistency. Hereby, it is assumed that a program does not involve circular 
dependencies between literals through an odd number of negations which might also cause 
inconsistency. Finding reasons for program inconsistency can be handled by our approach 
when an intended answer set is known, as illustrated by program L2 in Section |4T| Oth- 
erwise, an interpretation can be chosen from the answer sets resulting from temporarily 
removing all constraints from the considered program (providing this yields consistency). 

[Brain et al. (2007| l rewrite a program using some additional control atoms, called tags, 
that allow, e.g., for switching individual rules on or off and for analysing the resulting 
answer sets. Debugging requests in this approach can be posed by adding further rules that 
can employ tags as well. One such extension allows also for detecting atoms in unfounded 
loops. However, as opposed to our current approach, the individual loops themselves are 
not identified. 

[Caballero et al. (2008| l developed a declarative debugging approach for datalog using 
a classification of error explanations similar to the one by Gebser et al. (2008] l and our 
current work. Their approach is tailored towards query answering and, in contrast to our 
approach, the language is restricted to stratified datalog. However. ICaballero et al.l provide 
an implementation that is based on computing a graph that reflects the execution of a query. 

[Wittocx et al. (2009| l show how a calculus can be used for debugging first-order theories 
with inductive definitions in the context of model expansion problems, i.e., problems of 
finding models of a given theory that expand some given interpretation. The idea is to trace 
the proof of inconsistency of such an unsatisfiable model expansion problem. The authors 
provide a system that allows for interactively exploring the proof tree. 

Besides the mentioned approaches which rely on the semantical behaviour of programs, 
IMikitiuk et al.l (I2007l l use a translation from logic -program rules to natural language in 
order to detect program errors more easily. This seems to be a potentially useful feature for 
an IDE as well, especially for novice and non-expert ASP programmers. 



6 Conclusion 

Our approach for declaratively debugging non-ground answer-set programs aims at pro- 
viding intuitive explanations why a given interpretation fails to be an answer set of the 
program in development. To answer this question, we localise, on the one hand, unsatisfied 
rules and, on the other hand, loops of the program that are unfounded with respect to the 
given interpretation. As underlying technique, we use a sophisticated meta-programming 
method that reflects the complexity of the considered debugging question which resides on 
the second level of the polynomial hierarchy. 

Typical errors in ASP may have quite different reasons and many of them could be 
avoided rather easily in the first place, e.g., by a compulsory declaration of predicates 
jBrain and De Vos 20051 ). forbidding uneven loops through negation (Syrjanen 20061, in- 



troducing type checks, or defining program interfaces. We plan to reaUse these kinds of 
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simple prophylactic techniques for our future IDE for ASP that will incorporate our current 
debugging approach. In this context, courses on logic programming at our institute shall 
provide a permanent testbed for our techniques. Moreover, as part of an ongoing research 
project on methods and methodologies for developing answer-set programs (Oetsc h et al. 2010b . 
we want to put research efforts into methodologies that avoid or minimise debugging needs 
right from the start. As a next direct step regarding our efforts towards debugging, we plan 
to extend our approach to language features like aggregates, function symbols, and optimi- 
sation techniques such as minimise-statements or weak constraints. 
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